Word Lens
   HOME

TheInfoList



OR:

Word Lens was an
augmented reality Augmented reality (AR) is an interactive experience that combines the real world and computer-generated content. The content can span multiple sensory modalities, including visual, auditory, haptic, somatosensory and olfactory. AR can be de ...
translation application from Quest Visual. Word Lens used the built-in cameras on smartphones and similar devices to quickly scan and identify foreign text (such as that found in a sign or a menu), and then translated and displayed the words in another language on the device's display. The words were displayed in the original context on the original background, and the translation was performed in real-time without a connection to the internet. For example, using the viewfinder of a camera to show a shop sign on a smartphone's display would result in a real-time image of the shop sign being displayed, but the words shown on the sign would be the translated words instead of the original foreign words. Until early 2015, the application was available for the
Apple An apple is an edible fruit produced by an apple tree (''Malus domestica''). Apple fruit tree, trees are agriculture, cultivated worldwide and are the most widely grown species in the genus ''Malus''. The tree originated in Central Asia, wh ...
's iPhone,
iPod The iPod is a discontinued series of portable media players and multi-purpose mobile devices designed and marketed by Apple Inc. The first version was released on October 23, 2001, about months after the Macintosh version of iTunes ...
, and
iPad The iPad is a brand of iOS and iPadOS-based tablet computers that are developed by Apple Inc. The iPad was conceived before the related iPhone but the iPhone was developed and released first. Speculation about the development, operating s ...
, as well as for a selection of Android smartphones. The application was free on Apple's
iTunes iTunes () is a software program that acts as a media player, media library, mobile device management utility, and the client app for the iTunes Store. Developed by Apple Inc., it is used to purchase, play, download, and organize digital mul ...
, but an in-app purchase was necessary to enable translation capabilities. On
Google Play Google Play, also known as the Google Play Store and formerly the Android Market, is a digital distribution service operated and developed by Google. It serves as the official app store for certified devices running on the Android (operating sys ...
, there were both the free demo and the full translation-enabled versions of the application. At
Google Google LLC () is an American multinational technology company focusing on search engine technology, online advertising, cloud computing, computer software, quantum computing, e-commerce, artificial intelligence, and consumer electronics. ...
's unveiling of its Glass Development Kit in November 2013, translation capabilities of Word Lens were also demonstrated on
Google Glass Google Glass, or simply Glass, is a brand of smart glasses developed and sold by Google. It was developed by X (previously Google X), with the mission of producing an ubiquitous computer. Google Glass displays information to the wearer using ...
. According to the January 2014 ''
New York Times ''The New York Times'' (''the Times'', ''NYT'', or the Gray Lady) is a daily newspaper based in New York City with a worldwide readership reported in 2020 to comprise a declining 840,000 paid print subscribers, and a growing 6 million paid d ...
'' article, Word Lens was free for Google Glass.
Google Google LLC () is an American multinational technology company focusing on search engine technology, online advertising, cloud computing, computer software, quantum computing, e-commerce, artificial intelligence, and consumer electronics. ...
acquired Quest Visual on May 16, 2014 in order to incorporate Word Lens into its
Google Translate Google Translate is a multilingual neural machine translation service developed by Google to translate text, documents and websites from one language into another. It offers a website interface, a mobile app for Android and iOS, and an API t ...
service. As a result, all Word Lens language packs were available free of charge until January 2015. The details of the acquisition have not been released. Word Lens feature was incorporated into the
Google Translate Google Translate is a multilingual neural machine translation service developed by Google to translate text, documents and websites from one language into another. It offers a website interface, a mobile app for Android and iOS, and an API t ...
app and released on January 14, 2015.


Application

Word Lens is an
augmented reality Augmented reality (AR) is an interactive experience that combines the real world and computer-generated content. The content can span multiple sensory modalities, including visual, auditory, haptic, somatosensory and olfactory. AR can be de ...
application that recognizes printed words using its
optical character recognition Optical character recognition or optical character reader (OCR) is the electronic or mechanical conversion of images of typed, handwritten or printed text into machine-encoded text, whether from a scanned document, a photo of a document, a scen ...
capabilities and instantly translates these words into the desired language. This application does not require connection to the internet. In its default mode, Word Lens performs real-time translation, but can be paused to display a single frame or to look up alternative translations of each specific word in that frame. It is also possible to use the built-in dictionary to manually type in words that need to be translated. ''Word Lens 1.0'' was released on December 16, 2010, and received significant amount of attention soon after, including ''
Wired ''Wired'' (stylized as ''WIRED'') is a monthly American magazine, published in print and online editions, that focuses on how emerging technologies affect culture, the economy, and politics. Owned by Condé Nast, it is headquartered in San Fra ...
'', ''
The Economist ''The Economist'' is a British weekly newspaper printed in demitab format and published digitally. It focuses on current affairs, international business, politics, technology, and culture. Based in London, the newspaper is owned by The Econo ...
'',
CNN CNN (Cable News Network) is a multinational cable news channel headquartered in Atlanta, Georgia, U.S. Founded in 1980 by American media proprietor Ted Turner and Reese Schonfeld as a 24-hour cable news channel, and presently owned by the M ...
, ''
the New York Times ''The New York Times'' (''the Times'', ''NYT'', or the Gray Lady) is a daily newspaper based in New York City with a worldwide readership reported in 2020 to comprise a declining 840,000 paid print subscribers, and a growing 6 million paid ...
'', ''
Forbes ''Forbes'' () is an American business magazine owned by Integrated Whale Media Investments and the Forbes family. Published eight times a year, it features articles on finance, industry, investing, and marketing topics. ''Forbes'' also re ...
'', ''
the Wall Street Journal ''The Wall Street Journal'' is an American business-focused, international daily newspaper based in New York City, with international editions also available in Chinese and Japanese. The ''Journal'', along with its Asian editions, is published ...
'',
MIT The Massachusetts Institute of Technology (MIT) is a private land-grant research university in Cambridge, Massachusetts. Established in 1861, MIT has played a key role in the development of modern technology and science, and is one of the m ...
Technology Review ''MIT Technology Review'' is a bimonthly magazine wholly owned by the Massachusetts Institute of Technology, and editorially independent of the university. It was founded in 1899 as ''The Technology Review'', and was re-launched without "The" in ...
, and ~2.5 million views on YouTube in the first 6 days. Since the application held a No. 1 position on the lists of ''Top Free Apps'' and ''Top Grossing Apps'' on
iTunes iTunes () is a software program that acts as a media player, media library, mobile device management utility, and the client app for the iTunes Store. Developed by Apple Inc., it is used to purchase, play, download, and organize digital mul ...
for the few days following its release, it is currently described as ''Top In App Purchases''. In 2014, Word Lens was featured in the
Apple An apple is an edible fruit produced by an apple tree (''Malus domestica''). Apple fruit tree, trees are agriculture, cultivated worldwide and are the most widely grown species in the genus ''Malus''. The tree originated in Central Asia, wh ...
ad for
iPhone 5S The iPhone 5S (stylized and marketed as iPhone 5s) is a smartphone that was designed and marketed by Apple Inc. It is the seventh generation of the iPhone, succeeding the iPhone 5, and unveiled in September 2013, alongside the iPhone 5C. Th ...
br>''Powerful''
This application is currently available as ''Word Lens 2.2.3''.


Supported devices

Word Lens requires iPhone 3GS+,
iPod Touch The iPod Touch (stylized as iPod touch) is a discontinued line of iOS-based mobile devices designed and marketed by Apple Inc. with a touchscreen-controlled user interface. As with other iPod models, the iPod Touch can be used as a music pl ...
with a video camera,
iPad 2 The iPad 2 is a tablet designed, developed and marketed by Apple Inc. Compared to the first iPad, as the second model in the iPad line, it gained a faster dual core A5 processor, a lighter build structure, and was the first iPad to feature ...
+, or any
iPad Mini The iPad Mini (branded and marketed as iPad mini) is a line of mini tablet computers designed, developed, and marketed by Apple Inc. It is a sub-series of the iPad line of tablets, with screen sizes of 7.9 inches and 8.3 inches. The first-g ...
. In 2012, Word Lens was released for a selection of Android smartphones. In 2013, Word Lens became available for
Google Glass Google Glass, or simply Glass, is a brand of smart glasses developed and sold by Google. It was developed by X (previously Google X), with the mission of producing an ubiquitous computer. Google Glass displays information to the wearer using ...
, even though Google Glass itself is not yet freely available.


Supported languages

At the release, only English-to-Spanish and Spanish-to-English were supported, but other language dictionaries were planned, with European languages expected first. English-to-French and French-to-English were released on December 14, 2011. In 2012, English-to-Italian and Italian-to-English were added, followed by English-to-German / German-to-English and English-to-Portuguese / Portuguese-to-English in 2013, and English-to-Russian / Russian-to-English in 2014. Since the acquisition by Google in May 2014, all previously released language packs can be downloaded for free. It was also speculated that through incorporation into
Google Translate Google Translate is a multilingual neural machine translation service developed by Google to translate text, documents and websites from one language into another. It offers a website interface, a mobile app for Android and iOS, and an API t ...
, Word Lens would be extended to "broad language coverage and translation capabilities in the future".


Accuracy

According to its description, Word Lens is best used on clearly printed text and was not designed to translate handwritten or stylized fonts. This application was created to help tourists understand signs and menus, and it is not 100% accurate. The developer Otavio Good commented: "I will be the first to say that it’s not perfect, but perfect was not the goal". However, testers who took the app to other countries said it had been useful. Further, even though the application was not designed to read books, the ''
Wall Street Journal ''The Wall Street Journal'' is an American business-focused, international daily newspaper based in New York City, with international editions also available in Chinese and Japanese. The ''Journal'', along with its Asian editions, is published ...
'' journalist Ben Rooney managed to understand a page from ''Harry Potter y el Prisionero de Azkaban''.


Developers

Word Lens was developed by Otavio Good, a former video game developer and the founder of Quest Visual, John DeWeese, who previously worked on the
Electronic Arts Electronic Arts Inc. (EA) is an American video game company headquartered in Redwood City, California. Founded in May 1982 by Apple employee Trip Hawkins, the company was a pioneer of the early home computer game industry and promoted the d ...
game ''
Spore In biology, a spore is a unit of sexual or asexual reproduction that may be adapted for dispersal and for survival, often for extended periods of time, in unfavourable conditions. Spores form part of the life cycles of many plants, algae, f ...
'', and programmers Maia Good, Bryan Lin and Eric Park. A U.S. patent application on the technology was filed by the company in 2010 (based on a year-earlier provisional patent application), naming Good as inventor, but went abandoned for failure to respond to a Patent Office action. The application was published a
US20110090253


Competition

The
Google Goggles Google Goggles was an image recognition mobile app developed by Google. It was used for searches based on pictures taken by handheld devices. For example, taking a picture of a famous landmark searches for information about it, or taking a pictu ...
application for Android and iPhone has the capability to translate text or identify objects in an image, but it requires users to take a picture with their phones, and an active internet connection. Word Lens does it on the fly, meaning it's interpreting frames in video, almost in real time. A similar app called LookTel, designed to help blind people, scans print on objects such as packages of food and reads them aloud."


Reviews

Articles in the ''
Wall Street Journal ''The Wall Street Journal'' is an American business-focused, international daily newspaper based in New York City, with international editions also available in Chinese and Japanese. The ''Journal'', along with its Asian editions, is published ...
'' and ''
Tom's Guide ''Tom's Hardware'' is an online publication owned by Future plc and focused on technology. It was founded in 1996 by Thomas Pabst. It provides articles, news, price comparisons, videos and reviews on computer hardware and high technology. The si ...
'' cited Clarke's third law describing Word Lens: "Any sufficiently advanced technology is indistinguishable from magic". ''
The New York Times ''The New York Times'' (''the Times'', ''NYT'', or the Gray Lady) is a daily newspaper based in New York City with a worldwide readership reported in 2020 to comprise a declining 840,000 paid print subscribers, and a growing 6 million paid ...
'' journalist
David Pogue David Welch Pogue (born March 9, 1963) is an American technology and science writer and TV presenter. He is an Emmy-winning correspondent for ''CBS News Sunday Morning'' and author of the "Crowdwise" column in ''The New York Times'' Smarter Livi ...
included Word Lens in his list of "the best tech ideas of the year" 2010 (10 ideas total). In the ''
Wall Street Journal ''The Wall Street Journal'' is an American business-focused, international daily newspaper based in New York City, with international editions also available in Chinese and Japanese. The ''Journal'', along with its Asian editions, is published ...
'' article by Ben Rooney, Word Lens received a rating of 4/5 and was described as "a sort of magic". Word Lens was chosen as a finalist for the 2010
Crunchies The Crunchies was an industry award given out from 2007 to 2017 by several technology blogs to the Silicon Valley companies and venture capitalists they cover. The awards have been sponsored and co-hosted by blogs such as GigaOm, TechCrunch, Ventu ...
br>Best Technology Achievement award
Ellen of ''
The Ellen DeGeneres Show ''The Ellen DeGeneres Show'' (often shortened to ''Ellen'' or ''The Ellen Show'') is an American daytime television variety comedy talk show that was created and hosted by its namesake Ellen DeGeneres. Debuting on September 8, 2003, it was prod ...
'' demoed Word Lens and referred to it as "amazing" in her segmen
Ellen Found the Best Apps!
Otavio Good won th
2012
Netexplo award in the category ''Innovation & Technology'' presented at the
UNESCO The United Nations Educational, Scientific and Cultural Organization is a specialized agency of the United Nations (UN) aimed at promoting world peace and security through international cooperation in education, arts, sciences and culture. It ...
headquarters for the creation of Word Lens. ''
The New York Times ''The New York Times'' (''the Times'', ''NYT'', or the Gray Lady) is a daily newspaper based in New York City with a worldwide readership reported in 2020 to comprise a declining 840,000 paid print subscribers, and a growing 6 million paid ...
'' App Smart columnist Kit Eaton included Word Lens into his list of favorite apps.


History of updates

''Table updated on April 23, 2014 based on refs.''


See also

*
Augmented reality Augmented reality (AR) is an interactive experience that combines the real world and computer-generated content. The content can span multiple sensory modalities, including visual, auditory, haptic, somatosensory and olfactory. AR can be de ...
*
Optical character recognition Optical character recognition or optical character reader (OCR) is the electronic or mechanical conversion of images of typed, handwritten or printed text into machine-encoded text, whether from a scanned document, a photo of a document, a scen ...
*
Google Translate Google Translate is a multilingual neural machine translation service developed by Google to translate text, documents and websites from one language into another. It offers a website interface, a mobile app for Android and iOS, and an API t ...


References

{{reflist, 2


External links


Quest Visual homepage

Original video demonstration of Word Lens
* Otavio Goo
explains
Word Lens 1.0 * Otavio Goo
explains
Word Lens 1.0.1 (interview with
Reuters Reuters ( ) is a news agency owned by Thomson Reuters Corporation. It employs around 2,500 journalists and 600 photojournalists in about 200 locations worldwide. Reuters is one of the largest news agencies in the world. The agency was estab ...
)
Independent demo of Word Lens
*
Apple An apple is an edible fruit produced by an apple tree (''Malus domestica''). Apple fruit tree, trees are agriculture, cultivated worldwide and are the most widely grown species in the genus ''Malus''. The tree originated in Central Asia, wh ...
a
''Powerful''
featuring Word Lens for
iPhone 5S The iPhone 5S (stylized and marketed as iPhone 5s) is a smartphone that was designed and marketed by Apple Inc. It is the seventh generation of the iPhone, succeeding the iPhone 5, and unveiled in September 2013, alongside the iPhone 5C. Th ...
Discontinued iOS software Photo software Android (operating system) software Translation software Augmented reality applications